James-Stein Shrinkage and Second Order Efficiency in Semiparametrics
نویسندگان
چکیده
Abstract: The problem of estimating the centre of symmetry of an unknown periodic function observed in Gaussian white noise is considered. Using the penalized blockwise James-Stein method, a smoothing filter allowing to define the penalized profile likelihood is proposed. The estimator of the centre of symmetry is then the maximizer of this penalized profile likelihood. This estimator is shown to be semiparametrically adaptive and efficient. Moreover, the second order term of its risk expansion is proved to behave at least as well as the second order term for the best possible estimator using monotone smoothing filter. Under mild assumptions, this estimator is shown to be second order minimax sharp adaptive over the whole scale of Sobolev balls with smoothness β > 1. Thus, these results improve on Dalalyan, Golubev and Tsybakov (2003), where β ≥ 2 is required.
منابع مشابه
Stein Shrinkage with Penalization and Second Order Efficiency in Semiparametrics
Abstract: The problem of estimating the centre of symmetry of an unknown periodic function observed in Gaussian white noise is considered. Using the penalized blockwise Stein method, a smoothing filter allowing to define the penalized profile likelihood is proposed. The estimator of the centre of symmetry is then the maximizer of this penalized profile likelihood. This estimator is shown to be ...
متن کاملApplications of James–Stein Shrinkage (II): Bias Reduction in Instrumental Variable Estimation
In a two-stage linear regression model with Normal noise, I consider James–Stein type shrinkage in the estimation of the first-stage instrumental variable coefficients. For at least four instrumental variables and a single endogenous regressor, I show that the standard two-stage least-squares estimator is dominated with respect to bias. I construct the dominating estimator by a variant of James...
متن کاملReversing the Stein Effect
The Reverse Stein Effect is identified and illustrated: A statistician who shrinks his/her data toward a point chosen without reliable knowledge about the underlying value of the parameter to be estimated but based instead upon the observed data will not be protected by the minimax property of shrinkage estimators such a" that of James and Stein, but instead will likely incur a greater error th...
متن کاملBias Reduction in Instrumental Variable Estimation through First-Stage Shrinkage
The two-stage least-squares (2SLS) estimator is known to be biased when its first-stage fit is poor. I show that better first-stage prediction can alleviate this bias. In a two-stage linear regression model with Normal noise, I consider shrinkage in the estimation of the first-stage instrumental variable coefficients. For at least four instrumental variables and a single endogenous regressor, I...
متن کاملApplications of James–Stein Shrinkage (I): Variance Reduction without Bias
In a linear regression model with homoscedastic Normal noise, I consider James–Stein type shrinkage in the estimation of nuisance parameters associated with control variables. For at least three control variables and exogenous treatment, I show that the standard leastsquares estimator is dominated with respect to squared-error loss in the treatment effect even among unbiased estimators and even...
متن کامل